WO 99/45483 B A PCT/US99/04776 




image/ 
video 



visual indexing 



video 

segmentation 



Yideo object 

feature 

extraction 



captions/ 
transcripts— ^ 

audio/ ^ 

speech 



textual indexing 



audio/speech 




Keyword 


analysis 


— ► 


spotting 



semantb 
visual template 
library 



1 

I — ► 


visual 
search 
tools 




text- to- visual 
query sysn thesis 


1 


4 



merge results 



1 


textual 

search 

tools 


4 


I—* 





text 

processing 



user 

refinement 



user query 

input (text 

strings or 
speech) 



Figure 4 



WO 99/45483 



m 



2 I 3 



PCT/US99/04776 



in 




Figure 2 : A concept has necessary 
and sufficient conditions. 
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Figure 3: The Query generation mechanism. 



